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In this paper, the estimation of parameters in the har¬ 
monic regression with cyclically dependent errors is ad¬ 
dressed. Asymptotic properties of the least-squares esti¬ 
mates are analyzed by simulation experiments. By numer¬ 
ical simulation, we prove that consistency and asymptotic 
normality of the least-squares parameter estimator studied 
holds under different scenarios, where theoretical results do 
not exist, and have yet to be proven. In particular, these 
two asymptotic properties are shown by simulations for the 
least-squares parameter estimator in the non-linear regres¬ 
sion model analyzed, when its error term is defined as a 
non-linear transformation of a Gaussian random process dis¬ 
playing long-range dependence. 


where 

N 

(2) {Ak cos cpkt + Bk sin cpkt ), 
k=l 

with 0 = (^ 1 , ^ 2 , ^3: • • • 5 ^3Ar-2, ^sat) = 

(Ai, 5i, Atv, cl = Al ^ > 

0, /c = 1,..., A^, 0 < ip < ipi <' — < ifN < ^ < oo, and 

t G S}, S = M or Z, is the random noise process 
defining the error term through time. Process 5 is assumed 
to be a zero-mean stationary process. 

The LSE, Ot, of an unknown parameter 6^ G 0, ob¬ 
tained from the observations {x(t),t G [0,T]}, or {x(t),t = 
1,..., T}, is any random variable ^ 0^, having the prop¬ 
erty 

(3) 

Qt{§t) = inf Qt{t), Qt{t) = ^ f [x{t)-g{t,T)fu{dt), 

1 Jo 

where 0*^ is the closure of 0 and u{dt) represents a count¬ 
ing measure in the case of discrete time (i.e., u{t) = l,t G 
Z+ = N), and Lebesgue measure dt in continuous time (i.e., 
^{dt) = dt A ^ ^+)- 

Nonlinear regression models with independent or weakly 
dependent errors have been extensively studied (see, for 
example, [10, 8, 28, 24], and the references therein). The 
first results on nonlinear regression with errors having 
a slowly decreasing correlation function, i.e., with Long- 
Range Dependence (LRD) in discrete time were obtained 
by [26, 18, 17]. The volume [3] presents a review of the most 
relevant applications of processes with LRD. The asymp¬ 
totic theory of LSE in nonlinear regression with LRD has 
been considered in [23, 11, 12]. In papers [13, 14] asymp¬ 
totic distributions of a class of M-estimates and Lp-estimates 
(1 < p < 2) in nonlinear regression model with LRD form 
were presented. The problem of the estimation of the un¬ 
known parameters of the trigonometric regression with cycli¬ 
cal dependent stationary noise is studied in [16]. The au¬ 
thors derived LSE consistency and asymptotic normality of 
the regression function (2) parameters, and error term 5 be¬ 
ing a zero-mean stationary process, generated by nonlinear 
transformation of a stationary Gaussian process ^ displaying 
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1. INTRODUCTION 

Classical models of “hidden periodicities” have been 
widely studied and applied in natural sciences such as 
oceanography, astronomy, seismology and 
medicine. Early work on the estimation of the parameters in 
the harmonic regression can be found in [27] which first in¬ 
troduced an estimation “search” technique based on the pe- 
riodogram. The first studies of the problem in a more formal 
treatment can be seen in [1, 21, 5]. Least-squares estimate 
(LSE) of the parameters in the trigonometric regression and 
their asymptotic covariance matrix is studied in [33]. This 
problem can be formulated in the following way. Consider 
regression model 

( 1 ) x{t) = g{t,0)+e{t), 
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cyclical dependence. Specifically, for a stationary process ^ 
defined on a complete probability space P) : 

^(t) = t) : ft X E) — M. 

Such a process is assumed to satisfy the following assump¬ 
tion. 

Al. Random function ^ is a real-valued and measurable 
stationary mean-square continuous Gaussian process with 
E^{t) = 0, and = 1. Its covariance function (c.f.) is 

of the form: 

K, 

( 4 ) B it) = Eimm] = E it), 

j =0 

t eR, K > 0, Ej = 1, Pj > 0, j = 0,..., /i: , where 

_ cos {Xjt) 

-DcXj,>Cj — oxrv/2’ 


am > 1, (a = minj=o,...,/t ^ is Hermite rank of G (see 

below), the consistency and limiting Gaussian distribution 
of the LSE for general regression function are proven in [16]. 
Using limit theorems of [15] it can be seen that these results 
hold for (a > 1/2 and m = 1. In this article, the statements of 
the papers [15, 16] for the trigonometric regression function 
(2) for a > 1/2 are confirmed by simulation. In addition, 
for (a < 1/2 these results are unknown, but in this paper we 
show that they are correct also by simulation, at least for 
non overlapping spectra as is explained in Section 2.1. 

The outline of the paper is the following: a review of 
principal results concerning the asymptotic normality and 
consistency of LSE in regression model (1) is done in Sec¬ 
tion 2. A simulation study to prove the previous results is 
illustrated in Section 3. Also, some remarks on the asymp¬ 
totic properties of the LSE considering a broader range of 
values of model parameters that define the noise process are 
set out in this section. Section 4 provides the final comments 
and conclusions. 


0 < xq < < ... < aj > 0, t G M, j = 0,..., /i:. 

Although [16] dealts with the nonlinear regression model 
(1) with regression function (2), and cyclical dependent sta¬ 
tionary noise with covariance function (4) , the results given 
in [16] on linearization, and asymptotic uniqueness, as well 
as on asymptotic normality hold for a more general class of 
regression functions. The general class of non-linear regres¬ 
sion functions that could be considered includes the family 
of functions g such that, the family of matrix-valued mea¬ 
sures, defined by 


ii^{dx,e) = 


gUX,d)glriX,0))dX 


f gU\9) dXflg^(X,9)IUX 

.R R 


T > 0, 


1 

gi^(X,e) = j e^*^-Rg{t,e)dt, 


j = 1,..., g, A G M, G 0, weakly converges, as T —> oc, 
to an atomic spectral measure of regression function fj, with 
atoms . . . , 

Limit theorems for non-linear transformations of Gaus¬ 
sian stationary processes were considered. In the derivation 
of these limit results, the above mentioned weak-convergence 
to the spectral measure of regression function and the dia¬ 
gram formulae were applied. In the discrete case this phe¬ 
nomenon was discussed in [34, 35] for some other regression 
scheme. 

Although the model definition included possible LRD in 
the error term, this property has not been considered to 
show the asymptotic properties of the LSE. That is, for 


2. CONSISTENCY AND ASYMPTOTIC 
NORMALITY OF THE LSE OF THE 
PARAMETERS OF TRIGONOMETRIC 
REGRESSION 

In this section a review of the published work regard¬ 
ing consistency and asymptotic normality of the LSE of the 
parameters of trigonometric regression with cyclically de¬ 
pendent errors is carried out. The assumptions made on the 
Gaussian process ^ generating the random noise 5, represent¬ 
ing the time-dependent error term in the regression model 
(1) are summarized below. 

Random process ^ is assumed to satisfy condition Al. 
Therefore, the covariance function (4) admits the following 
spectral representation: 

B{t) = J e*^*/(A)dA, t e M, 

R 

where the spectral density (s.d.) is of the form: 

K, 

/(A) = E^i/a,,-yA), AeM, 

j =0 


with, faj,xj (A) being defined by 
Cl (o^j) 


faj,Xj (A) 


(1-^ + ^il) 1-^ + 


+K a,j-i (I A - Xj\) IA - Xj 


A e M, and 


Cl (Uj) 


2 ( 1 -«j )/2 
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Here, 




Thus, for jf = 0,..., /^, 0 < aj < 1 


z > 0, G M, is the modified Bessel function of the third 
kind and order v or McDonald’s function. 

The following asymptotic expansions are known (see, i.e., 
[4], formulae 8.485, 8.445 and 8.446): if z/ ^ Z, 


K_,{z) = K,{z) 




C2 (aj) 


+ |A — . 


|A + Xj|“^ {I - hj {\\ + Hj\)) 


\ a n—1 


{1 - hj {\X - Xj\)) 


Therefore, the s.d. / has 2/^ + 2 different singular points 

under condition 

Al, when kq ^ 0 , and 0 < < 1, j = 0,..., zi:. If xq = O 5 

the s.d. / has 2zi: + 1 different singular points. 

For aj = 1 and A ^ ±Xj : 


TT ^ 

2sin(7rO j\r{j + 1 -p) 

^ {z/2f^+’' \ 

“G^i!r(i + i + OJ ’ 

while if u = ±m, where m is a nonnegative integer. 




1 

2 


m —1 


E 


- 1 )! 

j! 


+(-ir+i^ 

j=0 


{zl2)^+^^ 
j\{m + j)\ 





-^^(j + 1) - + m+l) } , 


where '^{z) = {-^T{z))/T{z) is the logarithm derivative of 
the Gamma function. 

We have: for aj > 1 


lim /o 

A—^0 


,.0 W 



for aj = 1 , and A -G 0 


/i,., (A) ~ (| 2 ^, |) + T {In |A T I + In 2 + v|/(l)} , 

while for aj > 1 and A -G : 




1 r(^^) 

2 [ 20 fr(f)] ■ 


A2. The stochastic process 5 is given by e{t) = G(^(t)), 
t G M, with ^(t) satisfying condition Al, and G : M —^ 
M being a non-random measurable function such that 
FG(e(0)) = 0, and EG^{^{0)) < oc. 

Under condition A2, function G G I/ 2 (M, (/ 9 (x)dx), with 
(p{x) = 2 ^ X G M, being the standard Gaussian den¬ 

sity, and 


00 ^ 

(5) G(x) = ^ 

/C = l 


00 ^2 
k\ 

k=l 


F[G^(e( 0 ))]<oo, 


where 

Ck= f G{x)Hk{x)ip{x)dx. 

JR 

Here, the Hermite polynomials 


(6) 


Hk{x) = 


d’‘ _sl 

-P 2 

dx^ 


k = 0,l,2,..., 


/a,,o(A)-I{ln|AH-ln2 + «'(l)}, 

TT 

where T(l) = — 7,7 is the Euler constant. 

For 0 < Qfj < 1, and A ^ 0 

fa„oiX)=C2iaj)-^il-hji\X\)), 

|A| 

where C 2 {aj) = [2T{aj) cos and 



constitute a complete orthogonal system in the Hilbert space 
I/2(M, (p{x)dx). 

A3. We assume that the function G has Hermite rank 
Hrank{G) = m, that is, either Gi 7 ^ 0 and m = 1 , or, for 
some m > 2 , Gi = • • • = Gm-i = 0 , G^ 7 ^ 0 . 

Under conditions A1-A3, the process {^(t) = 

G(^(t)), t G M}, admits a Hermite series expansion in the 
Hilbert space I/ 2 (U,F, P) : 


00 ^ 

s{t) = cm) = E 

k=m 

In the following modification of the LSE proposed in [32] 
is used (see, also [7, 9]). Consider a monotone non-decreasing 
system of open sets St C S{ip, ip), T > Tq > 0, given by 
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the condition that the true value of unknown parameter (p 
belongs to 5 't, and 


lim inf 

T^oo l<j<k<N, cpeSr 


T{^Pk - ^j) = + 00 , 


(7) lim inf Tpi = +oo, 

^ T^ooipeST 


where 


S{p, p) = {O < p < Pi <’” < pn < p < 00 } . 


The LSE Ot in the Walker sense of unknown parameter 
0 = {Ai, Bi, pi,..., Ajsf, B]sf, Pn ) in the model (1) with 
nonlinear regression function ( 2 ) is said to be any random 
vector Ot G ©t having the property: 

Qt{0t) = inf Qt{t), 

re0T 


where Qt{t) is defined in (3), and ©t C is such that 
G M, B/c G M, /c = 1,..., A^, and p G the closure in 
of the set 5 't- 

Remark 2 . 1 . The 2nd condition (7) is satisfied if (^ > 0. If 
St C S{p,p), the relations given in (7) are, for example, 
satisfied for a parametric set 5 't, such that 


inf {pk 
^<j<k<N, 


^j) = r- 1 / 2 , inf = t- 1 / 2 . 


Theorem 2 . 1 . [16] Under eonditions A1 and A2, the LSE 
in the Walker sense 


Ot — {Ait, Bit, ^it, • • •, ^nt, Bnt, 0nt) 


of the unknown parameter 


defines parameter range a = minj=o,...,/t > 1/m. Here 

this condition is rewritten to include some differences and 
extension due to the consideration of a more general class 
of models. Simulations in Section 3 show that the Gaussian 
limit results hold for aj > 0, j = 0,..., / 1 :. A new condi¬ 
tion is formulated, A5, where the limit regression spectral 
measure and the spectrum of the Gaussian random process 
generating the error term may not be overlapped . 

A4’. Hrank(G) = 1, 0 < a < where a = 

miUjf =0 , 1 ,..., • 

A5. The singular points in the spectrum of noise, denoted 
as 'Enoise = {±>^ 0 , • • •, 0 < xq < < ... < and 

spectral measure atoms iiol be 

overlapped. That is, 'Enoise © 'Eregr = 0- 

The asymptotic Gaussian distribution of the LSE in the 
Walker sense of the regression function (2) is established in 
the following result. 

Theorem 2 . 2 . [16] Under eonditions A1-A4, the LSE in 
the Walker sense of the funetion (2) of unknown parameter 
is asymptotieally normal, that is, the veetor 

{T^/yAkT - A),T^^\BkT - B),T^/y0kT - V’)) , 

k = 1,..., N eonverges weakly to the multidimensional nor¬ 
mal veetor A 37 v( 0 , T), where the matrix V > 0 is of the form 
T = diag (T/e)^^^, with 


Tk 




j=m 


( Al + Bl -3AkBk -6Bk \ 

j ~‘ 3 A]^By; A\ + 1 

V - 6 Bfe QAk 12 ) 


9 = (Ai, Bi, (^ 1 ,..., Am, Bm, <pn) 

of the regression funetion (2) is weakly eonsistent asT ^ oo, 
that is, 

^ p p ^ p 

Akx ^ A}^j Bj^j, y Bj^, ^k) ^ O5 


Here, Y^\X), A e M, is the j-th eonvolution of the s.d. 
given under assumption Al. 

Theorem 2.2 follows Theorem 5 in [16] by direct compu¬ 
tations. In this theorem the limiting distribution of the LSE 
estimators is obtained for a more general class of g functions. 


P 

k = 1,... ,N, where —stands for the eonvergenee in prob¬ 
ability. 

The following condition is needed to prove the limiting 
normal distribution of the LSE of the parameters in the 
trigonometric regression with cyclically dependent errors. 
This constraint on a is opposed to the presence of LRD in 
noise process. 

A4. Either 1 ) Hrank(G) = 1 , a > 1 ; or 2 ) Hrank(G) = 
m > 2 , am > 1; where a = minj=o,i,...,/^ ^j- 

The asymptotic convergence to the Gaussian distribution 
of the LSE in the Walker sense of the function ( 2 ) is obtained 
in Theorem 2.2 for certain ranges of the parameters defining 
the spectral singularities of f. Specifically, assumption A4 


3. NUMERICAL RESULTS 

Let US consider the following model: 

( 8 ) x{t) = g{t,0) ^ G{f{t)), t G S+, S+= M+ or N, 
with nonlinear regression function, 

(9) g{t,0) = Acos{pt)B sm{pt), 

where 0 = {A, B,p), C = A^ ^ B^ > 0 , (^ < oc. Gonsider 
gi{t, 0) = {d/d0i)g{t, 0), i = 1 , 2 , 3, such that, 

pT 

d^T — / ^{dB) < oo, T > 0, i = 1,2,3. 

Jo 
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Let V^(t, 0) = 6 >), ^ 2 (L ^))' be the column vec¬ 

tor gradient of the function g{t,0). We use the notation 
d‘^{0) = diag(df^)f^;L- ^be theory of statistical estimation 
of unknown parameter ^ G 0 C for (8), the asymptotic 
behavior, as T ^ oo, of the functional 

(10) Ct = d-\0) r Vg{t, e)G{mMdt), 

Jo 

plays a crucial role, since, under certain conditions, the 
asymptotic distribution of the normalized LSE dT{0){0T — 
0), and properly normalized functional ( 10 ) coincide, as 
T^oo; see [ 10 , 11 ]. 

For model ( 8 ) we have, 

9 i{t,d) = ■^g{t,e) = cos{ipt), 

g 2 {t, 0 ) = -^g{t,0) =sm{ipt), 

gs{t^0) = -^g{t^0) = —Atsm{ipt) Bt cos {(ft). 


1,... ,T]} defined in (1), when T oo, and under the hy¬ 
pothesis of Theorems 2.1 and 2.2. The asymptotic normality 
of the LSE of parameters of model (1) is studied using simu¬ 
lated data. The numerical experiments have been conducted 
for different assumptions on noise distributions and values 
of the covariance function (4). 

We simulate the process (8) with different T values, 
A = B = ip = 0.6. The set St in equation (7) is chosen 
as St = (1/V^, 1). The generation of the random vectors 
t = 0,..., T} has been done from a multivariate nor¬ 
mal distribution with zero mean vector, and covariance ma¬ 
trix (11). The values of the parameters used to simulate the 
error term are x = 0.5, a = 0.85,1.50,2.50 for simulation 
experiment 1 and a = 0.25,0.45 for simulation experiment 
2. For each combination of x, a and G, we generate 1000 
different data sets from (8) using different sequences of ^(t). 

To illustrate the simulation method, we can write the 
random vector V = (^(l), • • •, C(^))^ 


In the capacity of function G, we take the first few Her- 
mite polynomials (see equation ( 6 )): 

Case HI: G{u) = 

Case H2: g\u) =u^ -I, 

Case H3: g\u) = — 3u, 

Case H4: G(^) = - 6u^ + 3. 


( 12 ) V = Lg, 

where g is an independent standard normal vector of dimen¬ 
sion T and L is a lower triangular Cholesky factor of E, so 
E = LL', with 


These four cases are under conditions A2 - A3. Random 
function ^ is a real-valued and measurable stationary mean- 
square continuous Gaussian process with E^{t) = 0, and 
= 1 , and covariance function: 


B(0) B{1) 

B{1) B{0) 

\B{T-1) B{T-2) 


B{T-1) \ 
B{T-2) 

B{o) y 


(11) i?(i) = ^^—§+=R+ or N. 

In this section, numerical results show the consistency 
for particular cases under conditions Al, A2, A4’ and A5. 
Specifically, the LSE in the Walker sense 

Ot = (At, Bt, 0t) 

of the unknown parameter 0 = {A^B^ip) of the regression 
function (9) seems to be weakly consistent as T ^ oc, under 
the assumption of LRD in process Moreover, the lim¬ 
iting distribution of the LSE in the Walker sense of the 
function (9) parameters for special cases under conditions 
A1,A2,A3,A4’ and A5 seems to be normally distributed. 

The paper [16] provides an analysis of the most rele¬ 
vant results concerning asymptotic normality of the LSE of 
trigonometric regression parameters. Here, we address the 
numerical problem of the estimation of the unknown pa¬ 
rameter from the observation of random process {x(t),t = 


Firstly, vector g is generated as an independent zero-mean 
Gaussian random vector. Secondly, we apply equation ( 12 ). 
In Figure 1, realizations of random vector V are shown for 
different values of a. Moreover, realizations of the error term 
5 generated by nonlinear transformation of stationary Gaus¬ 
sian process ^ can be seen in Figure 1 for above mentioned 
functions G. 

3.1 Simulation experiment 1 

Here, the results of the papers [15, 16] concerning the 
asymptotic normality and consistency of LSE in regression 
model ( 1 ) for the trigonometric regression function are con¬ 
firmed by simulation. The values of the parameters used to 
simulate the error term are x = 0.5, a = 0.85,1.50,2.50, 
(see. Figure 1). 

The convergence to the Gaussian distribution of the LSE 
of 0 in model ( 8 ) is checked by simulations studying of the 
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behavior of 


Ct 

Wl{T) 


C# 


Wl{T) 


and 


T 

'^^{cos , WA{t) = cos{(pt), 

t=l 

T 

y~^ (sin Wb (t) = sm{(fit ), 

t=l 


'sT 


W^{T) 

T 

= [—A sin ipt P B cos ipt] ^ 

d —1 

w^{t) 

7/— 1 

= t[—A sin ipt P B cos ipt]. 

for increasing values of T. 


Three statistical tests, Henze-Zirkler’s [ 6 , 29], Doornik- 
Hansen Omnibus [ 2 , 30] and the Chi-square plot [19, 31], 
are applied to the simulated random vectors to 

evaluate whether the data belongs to a multivariate normal 
distribution (MVN) or not. Although we can find many tests 
for MVN in the literature, the uniformly most powerful test 
does not exist and it is recommended to perform several 
tests to evaluate the belonging to MVN. These three tests 
are known to have good overall power against alternatives 
to normality (see, for example, [ 20 ]). 

Figure 2 shows the Chi-square quantile-quantile (Q-Q) 
plot. The graphs display the squared Mahalanobis distances 
of (C^, C^), T = 30000, versus quantiles of the Chi- 

square distribution with d degrees of freedom (d = 3, num¬ 
ber of variables). The squared Mahalanobis distance has 
an approximate Chi-squared distribution when the data 
are MVN. The interpretation is similar to the normal Q- 
Q plot, that is, if the graph is not linear, it can not en¬ 
sure the multivariate normal distribution. The linear plot 
of data for the cases displayed in Figure 2 , suggests that 
the asymptotic multivariate normality can be proved. In 
Table 1, rejection rates of Henze-Zirklers and Doornik- 
Hansen MVN tests applied to the simulated random vec¬ 
tors ((^^, for different T values are shown. These 

rates are calculated for significance level % 1 , using 50 
sets of simulated random vectors C^), with T = 

1000; 5000; 10000; 15000; 20000; 30000. Each set is composed 
of 1000 replications of (^^). It is noted that the rate 

of rejection decreases as T increases. For cases where the 
rate of rejection is higher, the value of T needs to be in¬ 
creased to ensure the MVN in the random vector ((^^, 

c?)- 


Also, consistency of the LSEs can be verified with the 
results in figures 5-6. Specifically, the small variance ob¬ 
tained suggests this property of the estimators under the hy¬ 
pothesis A1-A3. The LSEs {At,Bt,0t), T = [1000,5000], 
with discretization step size 250, of the parameters (A, H, ip) 
of the regression function (9), are computed numerically 
with Matlab function Isqnonlin based on the Levenberg- 
Marquardt algorithm (see, [ 22 ]). 

Another significant graph for random vectors with MVN, 
Vc^(/L 6 , (7), is the constant Probability Contours. This graph 
is represented as a ellipsoid formed for all x satisfying equa¬ 
tion (x — /[x)'(7“^(x — iJi) = with a constant c. The axes 
of the ellipsoid are /j. ± c\f\iei^ where and \i are the 
^th eigenvectors and eigenvalues of (7, [25]. In Eigure 3, the 
constant Probability Contours are calculated for each one of 
the cases studied, where C is estimated from the simulated 
sample of ((^^, (^^) values and c = 3, that is, if data 

are multivariate normally distributed, then 97% of the data 
should be inside the ellipsoid. In the same graph the scat¬ 
ter plot of the (C^, C^) values is represented. In most 

cases, the simulated values (shown as red dots) are within 
the ellipsoid of the theoretical distribution (shown in blue). 

3.2 Simulation experiment 2 

This subsection is aimed at proving asymptotic normality 
of d in model (8) under assumptions Al, A2, A3, A4’ and 
A5 by using simulation. We have considered model ( 8 ) with 
A = 1, H = 1 and ip = 0.6. The generation of the random 
vectors {^(t), t = 0,..., T}, is performed from a MVN with 
zero mean vector, and covariance matrix ( 11 ) with the val¬ 
ues of X = 0.5, a = 0.25, 0.45. As in the previous section, we 
have tested MVN with different tools, Eigure 7 shows Chi- 
square Q-Q plot of (C^, C^), T = 30000, for different 

combinations of the selected parameter values. The 97 % 
probability contours of a MVN and the scatter plot of ((^^, 
Ct 5 Ct)’ ^ = 30000, values are represented in Eigure 8 . Ei- 
nally, rejection rates of Henze-Zirklers and Doornik-Hansen 
MVN tests are calculated for 50 samples of size 1000 of the 
simulated random vectors (C^, (^) for different T values. 

The results are similar to the ones in the previous subsec¬ 
tion. Under conditions Al, A2, A3, A4’ and A5, normality 
and consistency (Eigures 9-11) of the sample estimator can 
be affirmed in most of the cases considered. Eor cases H3 
and H4 and low values of a, T must be increased to obtain 
a lower rejection ratio. 
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Table 1. Rejection rates of Henze-Zirklers (Tl) and Doornik-Hansen (T2) MVN tests applied to the simulated random vectors 

(Ct> Ct Ct) different T values. 


a 

Case 

Test 




T 



1000 

5000 

10000 

15000 

20000 

30000 

0.85 

HI 

Tl 

0.00 

0.04 

0.00 

0.00 

0.00 

0.00 



T2 

0.02 

0.00 

0.00 

0.00 

0.00 

0.00 


H2 

Tl 

0.02 

0.06 

0.00 

0.00 

0.00 

0.00 



T2 

0.06 

0.02 

0.00 

0.00 

0.00 

0.03 


H3 

Tl 

0.06 

0.00 

0.00 

0.00 

0.00 

0.00 



T2 

0.44 

0.04 

0.00 

0.00 

0.00 

0.00 


H4 

Tl 

1.00 

0.34 

0.10 

0.07 

0.05 

0.03 



T2 

1.00 

0.82 

0.40 

0.27 

0.15 

0.03 

1.50 

HI 

Tl 

0.00 

0.02 

0.00 

0.00 

0.00 

0.00 



T2 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 


H2 

Tl 

0.02 

0.00 

0.00 

0.00 

0.00 

0.00 



T2 

0.14 

0.02 

0.00 

0.00 

0.00 

0.00 


H3 

Tl 

0.08 

0.04 

0.00 

0.00 

0.05 

0.00 



T2 

0.30 

0.00 

0.00 

0.00 

0.00 

0.03 


H4 

Tl 

1.00 

0.22 

0.00 

0.07 

0.00 

0.00 



T2 

1.00 

0.82 

0.40 

0.13 

0.05 

0.00 

2.50 

HI 

Tl 

0.00 

0.00 

0.00 

0.00 

0.00 

0.03 



T2 

0.02 

0.02 

0.00 

0.07 

0.00 

0.07 


H2 

Tl 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 



T2 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 


H3 

Tl 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 



T2 

0.18 

0.00 

0.00 

0.07 

0.05 

0.03 


H4 

Tl 

0.96 

0.18 

0.00 

0.00 

0.00 

0.00 



T2 

1.00 

0.68 

0.10 

0.07 

0.00 

0.03 


Table 2. Rejection rates of Henze-Zirklers (Tl) and 
Doornik-Hansen (T2) MVN tests applied to the simulated 
random vectors for different T values. 


T 


a 

Case 

Test 

1000 

5000 

10000 

15000 

20000 

30000 

0.25 

HI 

Tl 

0.02 

0.04 

0.00 

0.00 

0.00 

0.00 



T2 

0.00 

0.02 

0.00 

0.00 

0.00 

0.03 


H2 

Tl 

0.24 

0.06 

0.00 

0.00 

0.05 

0.07 



T2 

0.70 

0.24 

0.30 

0.13 

0.05 

0.13 


H3 

Tl 

1.00 

0.36 

0.00 

0.13 

0.00 

0.07 



T2 

1.00 

0.92 

0.60 

0.53 

0.50 

0.37 


H4 

Tl 

1.00 

1.00 

1.00 

1.00 

0.85 

0.70 



T2 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.45 

HI 

Tl 

0.02 

0.02 

0.00 

0.00 

0.00 

0.00 



T2 

0.00 

0.02 

0.00 

0.13 

0.00 

0.00 


H2 

Tl 

0.06 

0.04 

0.00 

0.00 

0.00 

0.00 



T2 

0.06 

0.04 

0.00 

0.00 

0.00 

0.00 


H3 

Tl 

0.36 

0.02 

0.00 

0.00 

0.00 

0.03 



T2 

0.78 

0.12 

0.00 

0.00 

0.10 

0.03 


H4 

Tl 

1.00 

0.82 

0.20 

0.27 

0.10 

0.03 



T2 

1.00 

1.00 

0.80 

0.60 

0.30 

0.17 
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(a) a = 0.85, HI 


(b) a = 0.85, H2 


(c) a = 0.85, H3 





(g) a = 1.50, H3 


(h) a = 1.5, H4 


(i) a = 2.50, HI 


(e) Case HI 


(f) Case H2 




(j) a = 2.50, H2 


(k) a = 2.50, H3 


(1) a = 2.50, H4 


(g) Case H3 


(h) Case H4 


Figure 2. Chi-square Q-Q plot of the squared Mahalanobis 
distances of the simulated random vector , Ct' Ct )’ 


T = 30000. 


Figure 1. Simulated e process for cases: (a) a = 0.85, (b) 
a = 1.50, (c) a = 2.50 (top) and (a) a = 0.25, (b) a = 0.45 

(bottom). 


8 M.P. Frias et al. 























































































































(g) a = 1.50, H3 (h) a = 1.50, H4 


(i) a = 2.50, HI 



Figure 4. Variance of At, T g [1000,5000], with 
discretization step size 250, for cases: (a) a = O.Sb, (b) 
a = 1.50, (c) a = 2.50, case HI (top-left), case H2 
(top-right), case H3 (bottom-left) and case H4 
(bottom-right). 


(j) a = 2.50, H2 (k) a = 2.50, H3 


(1) a = 2.50, H4 


Figure 3. 97% Probability Contours of MVN and scatter plot 
for ((^^, , At) values, T = 30000. 
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Figure 5. Variance of Bt, T g [1000,5000], with 
discretization step size 250, for cases: (a) a = O.Sb, (b) 
a = 1.50, (c) a = 2.50, case HI (top-left), case H2 
(top-right), case H3 (bottom-left) and case H4 
(bottom-right). 


Figure 6. Variance of(pT, T G [1000,5000], with 
discretization step size 250, for cases: (a) a = O.Sb, (b) 
a = 1.50, (c) a = 2.50, case HI (top-left), case H2 
(top-right), case H3 (bottom-left) and case H4 
(bottom-right). 
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(g) a = 0.45, H3 


(h) a = 0.45, H4 


(g) a = 0.45, H3 


(h) a = 0.45, H4 


Figure 7. Chi-square Q-Q plot of the squared Mahalanobis 

distances of the simulated random vector , Ct - Cr )’ Figure 8. 97% Probability Contours of MVN and scatter plot 

T = 30000. for (Ct> Ct' Ct) values, T = 30000. 


Detecting hidden periodicities for models with cyclical errors 11 
































Figure 9. Variance of At, T g [1000,5000], with Figure 10. Variance of Bt, T g [1000,5000], with 

discretization step size 250, for cases: (a) a = 0.25, (b) discretization step size 250, for cases: (a) a = 0.25, (b) 

a = 0.45,case Fll (top-left), case H2 (top-right), case 1-13 a = 0.45,case Fll (top-left), case 132 (top-right), case 133 
(bottom-left) and case 134 (bottom-right). (bottom-left) and case 134 (bottom-right). 
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Figure 11. Variance of(pT, T G [1000,5000], with 
discretization step size 250, for cases: (a) a = 0.2b, (b) 
a = 0.45, case HI (top-left), case H2 (top-right), case H3 
(bottom-left) and case H4 (bottom-right). 
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4. FINAL COMMENTS 

This paper studies the estimation of hidden periodicity in 
a nonlinear regression model with stationary noise display¬ 
ing cyclical dependence. The problems of consistency, and 
Gaussian limit distribution of the LSE, in the Walker sense, 
for the harmonic regression model are addressed. This kind 
of regression constitutes an active research area, due to the 
existence of several open problems and applications. In pre¬ 
vious work, such as in [16], the parameter range am > 1, 
a = minj=o,...,/^ Qfj: with m is Hermite rank of G (see, (5)), 
was considered. Here we have checked, by simulation experi¬ 
ments, that the Gaussian limit results hold for 0 < a < 1/2, 
m = 1. 

Specifically, the results proven in [15, 16] for the trigono¬ 
metric regression function (2) for a > 1/2 have been con¬ 
firmed by simulation. Some experiments have been done to 
determine the validity of these results for a < 1/2, under 
the assumption of non overlapping spectra. Gonsistency and 
asymptotic MVN of the LSE in the trigonometric regres¬ 
sion has been verified. However, the convergence rate to the 
MVN differs for each case included in the study. 
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